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This listing of claims will replace all prior versions, and listings, of claims in the application:! 
Listing of Claims; 

1 (currently amended): A system for receiving audio input comprising: 

a display for displaying electronic information; 

an audio input receiving audio cont e nt annotations ; and, 

a processor for associating said received audio cont e nt annotations with said displayed 
electronic information , wherein said processor further associates an author with each of said 
audio annotations, each of said audio annotations being randomly accessible based on the author . 

2 (currently amended): The system according to claim 1, wherein said audio eentent annotations 
is in the form of audio clips. 

Claim 3 (canceled) 

4 (currently amended): The system according to claim 34, further comprising: 

a storage for storing each of said audio eefttent annotations with said at l e ast on e 
prop e rty the associated author . 

5 (currently amended): The system according to claim 1, further comprising: 

an input receiving a user's input, 

wherein said processor starts recording an audio c o nt e nt annotation from said audio input 
in response to said user's input. 

6 (currently amended): The system according to claim 1, wherein said processor includes a 
voice activated recording system for recording said audio cont e nt annotation . 

7 (currently amended): The system according to claim 6, wherein said voice activated recording 
system records when said audio content annotation exceeds a predetermined threshold. 
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8 (currently amended): The system according to claim 6, wherein said voice activated recording 
system records when a known user's voice is detected in said audio eenten tannotati on . 

9 (currently amended): The system according to claim 1, wherein said processor controls said 
display to indicate that an audio eenteftt annotation is associated with said displayed electronic 
information. 

10 (currently amended): A system for playing audio content, said system comprising: 

a display for displaying electronic information; 

a storage for storing audio eenteni annotations , each of said audio eenten tannotations 
including prop e rti e s an author and being associated with said displayed electronic information^ 
each of said audio annotations being randomly addressable based on the author ; 

an output for outputting at least some of said audio eentent annotations responsive to 
navigation of said displayed electronic information; and 

a processor for controlling said display, said storage and said output. 

11 (currently amended): The system according to claim 10, wherein said audio 
eefrtentannotations includes audio clips. 

Claim 12 (canceled) 

13 (original): The system according to claim 12, wherein said storage is a database. 

14 (currently amended): The system according to claim 10, further comprising: 

an input for receiving a user's input, 

wherein said output outputs at least some of said audio eenteftt anno tat i on s in response to 
receiving said user's input. 
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15 (currently amended): The system according to claim 10, further comprising: 

an input for receiving a user's input of an author , 

wherein said processor searches properties — authors of said stored audio 
cont e nt annotations in response to said user's input. 

16 (original): The system according to claim 15, wherein the output of said processor is sent to 
said display to display an indication of the search results. 

17 (currently amended): The system according to claim 15, wherein the output of said controller 
is sent to the output for playing an audio cont e nt annotation with prop e rti e s an author matching 
the search results. 

18 (currently amended): The system according to claim 10, wherein said processor retrieves all 
audio content annotations associated with said electronic information when said electronic 
information is accessed. 

19 (currently amended): The system according to claim 10, wherein said processor outputs 
selected audio cont e nt annotations to be played through said output when a page of said 
electronic information is displayed. 

20 (currently amended): The system according to claim 19, wherein said processor 
automatically plays said selected audio cont e nt annotations when said page is displayed. 

21 (currently amended): The system according to claim 10, further comprising: 

a communication link to transmit said audio eontent anno tat i on s . 

22 (currently amended): The system according to claim 21, further comprising: 

a network connected to said communication link for receiving said audio 
eontent annotations , said network being accessible by other users. 
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23 (currently amended): The system according to claim 21, further comprising: 

a receiving device of another user for receiving said audio eenten iannotations . said 
receiving device receiving said audio cont e nt annotations through one of a wired or wireless 
interface. 

24 (currently amended): The system according to claim 22, wherein said network further 
processes said audio eontent annotations . 

25 (currently amended): The system according to claim 22, wherein said network includes a 
database for storing said audio eontefrt annotations . 

26 (currently amended): The system according to claim 22, wherein said network receives audio 
cont e nt annotations without receiving said electronic information associated with said audio 
cont e nt annotations . 

27 (original): A user interface for displaying electronic information to a user comprising: 

a first display portion for displaying a portion of a document; and 

a second display portion for displaying a graphical indication that said document includes 
an audio annotation associated with said displayed portion of said document. 

28 (original): The user interface according to claim 27, further comprising: 

a third display portion for displaying a non-audio annotation. 

29 (original): The user interface according to claim 27, further comprising: 

a third display portion for displaying an indication that said audio annotation is being 
recorded or played back. 

30 (original): The user interface according to claim 27, further comprising: 

a third display portion for displaying one of a document tape or a master tape. 
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3 1 (original): The user interface according to claim 27, further comprising: 

a third display portion for receiving a user input of a property or properties of said audio 
annotation. 

32 (original): The user interface according to claim 27, wherein said audio annotation is 
recordable by said user. 

33 (original): A process for recording an audio annotation comprising the steps of: 

displaying electronic information; 
receiving a user input; 

recording an audio annotation in response to said user input; and 

associating said audio annotation with properties including a displayed portion of said 
electronic information. 

34 (original): The process according to claim 33, further comprising the step of: 

storing said audio annotation prior to the association of said audio annotation with said 
displayed portion. 

35 (original): The process according to claim 33, further comprising the step of: 

storing said audio annotation after the association of said audio annotation with said 
displayed portion. 

36 (original): The process according to claim 33, wherein said recording step records all ambient 
sounds. 

37 (original): The process according to claim 33, wherein said recording step records only 
sounds above a predetermined threshold. 

38 (original): The process according to claim 37, wherein said recording step records only a 
specific user's voice. 
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39 (original): The process according to claim 33, further comprising the step of: 

associating additional properties with said audio annotation at the start of recording of 
said audio annotation. 

40 (original): The process according to claim 33, wherein one of said properties is a file position 
or document position of an item on said displayed portion of said electronic information. 

41 (original): The process according to claim 33, wherein one of said properties is a start 
identification of said displayed portion of said electronic information. 

42 (original): The process according to claim 33, further comprising the steps of: 

storing said audio annotation; and, 

searching audio annotations including said audio annotation for at least one property 
matching a query. 

43 (original): A process for playing audio annotations comprising the steps of: 

displaying a portion of electronic information; 
receiving a user input; 
retrieving audio annotations; 

assembling said audio annotations into an audio stream; and 
playing said audio stream. 

44 (original): The process according to claim 43, further comprising the step of: 

waiting for a second user input prior to playing said audio stream. 

45 (previously presented): The process according to claim 43, further comprising the step of: 

playing said audio stream once said audio stream is assembled. 

46 (original): The process according to claim 43, wherein said user input is a text query. 
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47 (original): The process according to claim 43, wherein said user input is a voice query. 

48 (original): The process according to claim 43, further comprising the steps of: 

altering the display of said portion to match a currently playing annotation in said audio 

stream. 

49 (previously presented): The process according to claim 48, wherein said altering step 
includes the steps of: 

comparing the length of said currently playing annotation with starting identifications of 
displayable portions of said electronic information; and 

displaying the portion of said electronic information supporting the greater length of said 
currently playing annotation. 

50 (original): A process for playing audio annotations comprising the steps of: 

navigating to a page; 

retrieving at least one audio annotation associated with a page or associated with an item 
on a page; and 

playing said at least one audio annotation. 

5 1 (original): The process according to claim 50, further comprising the step of: 

waiting for a user input prior to playing said audio annotation. 

52 (original): The process according to claim 50, wherein said item on said page includes at 
least one of embedded notes, inked notes, highlights and underlining. 

53 (original): The process according to claim 50, wherein said at least one audio annotation was 
previously retrieved and said retrieving step includes indexing said previously retrieved at least 
one audio annotation. 
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54 (original): The process according to claim 50, wherein said at least one audio annotation is 
the result of a newly executed query. 

55 (original): A computer readable medium having a data structure stored thereon, said data 
structure comprising: 

a document; 

a link object; and 

audio content with at least one property, 

wherein said link object references said document and references said audio content. 

56 (original): The data structure according to claim 55, wherein said property relates to the time 
said audio content started recording. 

57 (original): The data structure according to claim 55, wherein said property relates to the time 
said audio content stopped recording. 

58 (original): The data structure according to claim 55, wherein said property relates to the 
length of recording of said audio content. 

59 (original): The data structure according to claim 55, wherein said property relates to the 
author of the recording. 

60 (original): The data structure according to claim 55, wherein said property relates to the start 
ID. 

61 (original): The data structure according to claim 55, wherein said property relates to the stop 
ID. 

62 (original): The data structure according to claim 55, wherein said audio content is comprised 
of a plurality of audio clips. 
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63 (original): The data structure according to claim 62, wherein said audio clips are stored in a 
database. 

64 (original): The data structure according to claim 55, wherein said property is one of plurality 
of properties and said properties are in a marked up language form. 

65 (original): The data structure according to claim 64, wherein said properties are in XML. 

66 (original): The data structure according to claim 55, wherein said audio content is stored 
within a document. 

67 (original): The data structure according to claim 55, wherein said audio content is stored 
apart from a document. 

68 (original): The data structure according to claim 67, wherein said audio content is stored in a 
database with at least one property designating the position of viewed document relating to said 
audio content. 

69 (original): The data structure according to claim 67, wherein said audio content is stored in a 
database and linked to a separate annotation document that stores the position of a viewed 
document relating to said audio content. 

70 (original): A process for recording audio content comprising the steps of: 

navigating to a page of a document; 
recording said audio content; and 

associating properties with said audio content such that retrieval of said audio content 
positions said audio content after previously recorded audio content. 

71 (previously presented): The process according to claim 70, wherein said audio content 
comprises audio clips and wherein said properties include a time property. 
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72 (original): The process according to claim 71, wherein said audio content and said previously 
recorded audio content is ordered at least by said time property. 

73 (original): A process of searching audio clips comprising the steps of: ' 

inputting search terms or properties; 

searching said audio clips for said search terms or properties; and 
ordering audio clips detected by said searching step for output. 

74 (original): The process according to claim 73, wherein said inputting step further comprises 
the steps of: 

receiving verbally delimited keywords; and 

converting said verbally delimited keywords into search terms or properties. 

75 (original): A process for recording audio information comprising the steps of: 

recording audio signals as a first file; 
processing said file to extract audio clips; and 
storing said audio clips, 

wherein said processing separates the content of said first file into audio clips based on 

events. 

76 (original): The process for recording according to claim 75, 

wherein said audio signals include speech, and 

wherein said events comprise at least one of short pauses in said speech, a pause of a 
predetermined length, and a user navigating away from a displayed page. 

77 (previously presented): A process for associating audio notes and handwritten notes 
comprising the steps of: 

creating a handwritten note; 

associating a time at which said handwritten note was created with said handwritten note; 
creating an audio note; and 
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associating a time at which said audio note was created with said audio note, 
wherein, upon selection of said handwritten note, audio notes created at or near the time 
at which said handwritten note was created are located with said handwritten note. 

78 (original): The process according to claim 77, wherein locating said audio notes includes the 
step of querying a database for audio clips. 

79 (original): The process according to claim 77, wherein locating said audio notes includes the 
step of searching a table. 

80 (original): The process according to claim 77, wherein locating said audio notes includes the 
step of searching a linked list. 

81 (original): The process of claim 77, wherein said audio notes are comprised of audio clips in 
which each audio clip has a time of creation associated with each audio clip. 

82 (original): The process according to claim 77, further comprising the step of: 

playing said audio notes. 

83 (original): A process for playing audio notes comprising the steps of: 

displaying a first page of electronic information; 
playing audio notes associated with said first page; 
displaying a second page of electronic information; and, 
playing audio notes associated with said second page. 

84 (original): The process according to claim 83, further comprising the step of receiving user 
input, 

wherein, in response to said user input, said second page is displayed. 



Page 12 of 17 



AppIn.No.: 09/768,813 
Amendment dated August 11, 2005 
Reply to Office Action of May 11, 2005 

85 (original): A process of recording audio notes comprising the steps of: 

displaying a first page of electronic information; 

recording a first set of audio notes; 

associating said first set of audio notes with said first page; 

displaying a second page of electronic information; 

recording a second set of audio notes; and 

associating said second set of audio notes with said second page. 

86 (original): The process according to claim 85, further comprising the step of receiving user 
input, 

wherein, in response to said user input, said second page is displayed. 
Claims 87-88 (canceled) 
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